Coupled Ito equations of continuous quantum state measurement, and estimation 
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We discuss a non-linear stochastic master equation that governs the time-evolution of the esti- 
mated quantum state. Its differential evolution corresponds to the infinitesimal updates that depend 
on the time-continuous measurement of the true quantum state. The new stochastic master equation 
couples to the two standard stochastic differential equations of time-continuous quantum measure- 
ment. For the first time, we can prove that the calculated estimate almost always converges to 
the true state, also at low-efficiency measurements. We show that our single-state theory can be 
adapted to weak continuous ensemble measurements as well. 
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Introduction. For seven decades after the completion 
of quantum theory, sequential measurements on a sin- 
gle quantum system were not technically accessible. Ad- 
vancements of experimental technology have finally al- 
lowed multiple measurements under full control. Time- 
continuous measurements on a single system have also 
become feasible. Their theory concluded to a flexible 
Ito-stochastic calculus. It describes the time evolution 
of the measured state p t under continuous measurement 
of a certain variable q as well as the evolution of the 
time-dependent measurement signal qt- Recent perspec- 
tives of feed-back control shed new light on the problem. 
The time-continuous, or real-time, state determination 
became an immediate theoretical task. Doherty et al. Q 
worked out a theory for a specific case (cf. an application 
for feedback induced cooling Q). A related different task 
has been discussed independently Q. Our present pro- 
posal, sketched already in Ref. [4j, extends the results of 
|l| for the whole class of systems under (time-)continuous 
measurement, and we prove the general convergence of 
the real-time estimate to the true state. Our concept 
will be slightly different from that of Ref. . We do not 
think of integrating the stochastic differential equation of 
continuous measurement. Rather, we emphasize that the 
estimated state p\ satisfies a further Ito-stochastic equa- 
tion driven by the (noisy) measurement signal qt- This 
allows us to prove that the Hilbert-Schmidt distance be- 
tween the unknown state pt and the calculated real-time 
estimate p\ is decreasing until p t and p\ will coincide: 

lim \\p\-p t \\ =0. (1) 

t — >oo 

This convergence implies for example the possibility to 
monitor quantum oscillations in real-time (cf. 0|). The 
structure of our Letter is the following. We first intro- 
duce the elementary measurement-update cycle and the 
weak-measurement limit. Then we present the Ito equa- 
tions of our proposal, and we provide the proof of the 
above convergence theorem. We discuss and verify the 
theory also for non-maximum efficiency of the continu- 



ous measurement. Finally, an application to collective 
measurements is shown. 

Unsharp measurement and update of states. In all 
continuous measurement and/or estimation theories, un- 
sharp measurements play a central role. Consider the 
standard Gaussian model of unsharp measurement of a 
variable 9 @|. If p is the a priori state the measurement 
outcome q will have the following probability distribu- 
tion: 

p(q) = tr [G a (q - q)p] = (G a {q - q)) h (2) 

where G„ is the normalized Gauss function of spread 
a. The following standard update yields our a posteriori 
state: 

p^^-Gl'^q-qypGy^q-q). (3) 

If the a priori state p is unknown then also the a posteriori 
one remains unknown. We can, nonetheless, estimate the 
a priori state, say by a certain p e . Then we apply the 
same update to our a priori estimate p e as to the true 
state above: 

P e — ^4) G ^ /2 (« - <l)P eG l /2 (<l ~ <?)• (4) 

Please note that the normalization factor is different than 
in Eq. 0. The normalizing function p e (q) has, although 
we employ similar notation, no role as a probability dis- 
tribution. We expect that by using weak measurements, 
i.e. when the unsharpness a is very large, iterating the 
updates (121 1^ brings the estimate and the true state 
closer to each other. It therefore makes sense to re- 
peat the above measurement-update-cycle many times 
at high frequency v in order to make the real-time es- 
timate p\ converge to the true state pt, as claimed in 
Eq.([Q). Below we prove this remarkable convergence in 
the weak- measurement continuous-time limit (3, where 
both the unsharpness a and the repetition frequency v of 



2 



the measurement-update cycle tend to infinity while the 
ratio v/a 2 remains constant: 



v 



(5) 



The quantity 7 is called the strength of the continuous 
measurement. In this limit, Eqs. (121 til result in three 
Ito stochastic differential equations, respectively, for the 
time-dependent outcome (signal) q t of the measurement, 
for the true state pt and for the estimate pf, which con- 
stitute the theory of continuous measurement and esti- 
mation. 

The three coupled Ito equations. Let us first postulate 
the heuristic theory. Consider an observable q which we 
measure continuously. The signal is governed by a simple 
stochastic equation: q t — {qt)p t + 7~ 1 / 2 u>t where {qt)p t 
stands for the mean value of q in the current quantum 
state pt- The wt is the standard white-noise defined by 
E[u> t ] = and E[iy t w s ] = 5(t — s) where E stands for the 
stochastic mean. This form of the observed value qt is 
plausible: it fluctuates around the quantum mean value 
and the magnitude of the fluctuations is proportional to 
the strength of the continuous measurement. Due to its 
non-linearity, however, the naive equation must be re- 
placed by the mathematically precise Ito equation: 



dQ = (q) e dt + -/- 1 ^dW 



(6) 



where Qt, Wt are the time- integrals of qt and Wt, respec- 
tively. From now on, we call Qt the integrated signal of 
the continuous measurement. For notational convenience 
of Eq.© and of further equations, the lower indices t are 
systematically ignored. 

The second Ito equation governs the state pt under 
continuous measurement of q. For Markovian mecha- 
nisms, like ours, the Ito increment dpt of the state will 
only depend on the current state pt and on the current 
Ito increment dQt of the (integrated) signal [j| : 



dp 



1 

-i[H,p]dt - ~[q, [q,p]]dt 

+l{q~(q)p,p}(dQ-(q)pdt), (7) 



where H is the Hamiltonian. Obviously, at any time t, 
Pt is conditioned on the previous measurement outcomes 
through {Q s ; s < t}. 

The third Ito equation governs the evolution of our 
estimate p%: 

d(f = -t[H,p e ]dt-l[q,[qr P e ]]dt 

+l{q-(q)pe,p e }(dQ-(q)^dt) . (8) 

The structure of this equation coincides with the struc- 
ture of Eq. J7J , but dQ in here depends on the true state 
p, cf. Eq. ©. 



The Eqs. (16l8ti constitute the theory of continuous 
measurement and estimation. The second and third can 
also be called the stochastic master equation (SME) of 
measurement and estimation, respectively. The first two 
constitute the theory of continuous measurement and 
they were shortly derived from unsharp measurements 
(121 III in the weak-measurement continuous-time limit, cf. 
Ref. [jj. The proof relies on the approximation 



p(q) w G a (q - (q)p) 



(9) 



valid for large a. We can easily confirm the novel SME 
from Eq. (@J, without adapting the (otherwise sim- 
ple) derivation p| of (|HI7|) from Eqs. J2EJ). By change of 
variables, we are going to show that J2J and (@J become 
asymptotically identical. Let us consider the expression 
(0J of the updated estimate and calculate the normalizing 
denominator for large a: 



P e (q)^G rT (q^(q)^)- 



Let us introduce new variables: 



(10) 



q e = q - (tip- + (q)p 
and, of course, q e = q — (q) p « + (q) p . Please observe that 
p e (q) — p(q e ) and re- write (@J into this form: 



1 



P 



p(q e ) 



cy v - wcyv - n (n) 



This is exactly the same equation as equation J3J updat- 
ing the true state p. Therefore the SME for p e will, in 
the new variables q e ,q e , coincide with the SME J7J of p: 

d P e = -i[H, P e ]dt-^[q £ ,[q e rp e ]]dt 

+ \{q e ~ (q e )p^P e } (dQ e - (f}pedt) . (12) 

If we restore the original variables q = q e + (q) p? — {q)p 
and dQ = dQ e + (q)p^dt — {q)pdt, we obtain Eq. (|SJ). 

Proof of convergence. For long times, both the actual 
state of the system, p t , and the estimated state pf become 
pure states. Therefore it will be sufficient to prove that 
the fidelity tr[/5 t /5|] tends to 1 for large t. We detail the 
proofs below. 

First we note that all three equations (l(il8ll are invari- 
ant under the trivial shifts q — > q + r, dQ — » dQ + rdt, for 
arbitrary real constant r. In all time-local calculations 
we can, e.g., make (q)p zero by choosing r = —(q)p and 
we can restore the true result at the end of the calcula- 
tion if we make a second shift by — r. This allows quicker 
calculations and we shall refer to this as shift invariance. 

For long times the solutions pt of the SME © are 
known to turn into pure states mUM To prove this, we 
show that the increment of E [tr[/5j]] is non-negative: 



rfE tr[p 2 ] = E tr[2 pdp + dpdp] 



> 0. 



(13) 



Using the Ito equations (l(il7l in the shifted coordinate 
system where (q)p = 0, the l.h.s. can be written as the 
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trace of a nonnegative matrix: 



tr[p 2 



= tx[pqpq]=tx (fi^qfi 1 / 2 ) 2 



(14) 



which is greater than zero and vanishes if fit is already a 
pure state. In certain marginal cases the growth of pu- 
rity may get stalled, we discuss this problem later. How- 
ever, in generic physical situations the r.h.s. of Eq. I|14|) 
becomes zero only if fi t turns into a pure state. The 
presented proof implies the longtime purity of fi\ as well 
since, in suitable variables, the SMEs of fit and fi e t are 
identical, cf. Eqs.0 and iff^l . respectively. 

Finally we prove that, in the generic case, tr[/St/Sj] — > 1 
when t — ► oo. The task is to show that 

cffi ti[fifi e ] = E tr[dfifi e + fidfi e + dfidfi e ] > , (15) 

with equality if and only if fi e = fi for all typical, phys- 
ically interesting situations. Using shift invariance, we 
can set (q)p + (q) ^ = 0. Substituting Eqs. I|7I8|I yields 
the following result: 
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dt 



tr[fifi e 



(16) 



= (q) 2 tr [fifi e ] + tr [fiqfi e q] + tr [q{p, fi e }} 



tr 



fi 1/2 (q+{q)p)fi e (q+{q)p)fi 1/2 



The r.h.s. is the trace of a nonnegative matrix. This 
assures that the fidelity is monotonously increasing until 
fi e = p is reached asymptotically. We shall emphasize 
that the convergence may cease for marginal cases, see 
our discussion below. Nevertheless, in generic physical 
applications convergence will always be achieved. This 
claim is supported by numerical simulations, and also by 
the fact that in the one-qubit case, if [H, q] ^ 0, one can 
exactly prove that the r.h.s. of Eq. Ijl6(l can vanish only 
if the true and the estimated state coincide, fi e — fi. 

Extension for low- efficiency measurements. The the- 
ory of continuous measurement (|6I7(I corresponds to per- 
fectly efficient continuous measurements, i.e., the signal- 
to-noise ratio reaches the quantum mechanically possi- 
ble maximum value. Real continuous measurements are 
producing and/or are accompanied by an excess noise. 
Therefore they cannot preserve or reach the purity of 
continuously measured states although they limit their 
mixedness. Wiseman and Milburn 12] have already in- 
corporated the efficiency parameter r\ s [0, 1] into the 
theory (|6I7|) . and we do it for the novel SME © as well: 

dQ = (qjpdt + i^^^dW (17) 

1 

dfi = -i[H,p]dt - -[q,[q,p]]dt 

+^{q-{q)p,p}(dQ-{q)^dt), (is) 

dfif = -t[H,fi e ]dt-l[q,[q,fi e ]}dt 

+Y{q-(q)p^fi e }{dQ-(q)^dt) . (19) 



Our SME l|19|) of estimation works for lower efficiencies 
i] < 1 as well. We expect that the convergence {IJ of 
the estimate fif and the true state fit will slow down if 
r\ <C 1, still it exists for all nonzero efficiencies rj. The 
former proof cannot be applied directly because it relied 
upon the longtime purity of both fi t and fi\ . Yet, we can 
reduce the proof of the case rj < 1 to the former proof of 
the case rj = 1. Let us outline the steps. 

In the two SMEs i|18ll9[l . let us separate the excess 
noise from that which is necessary for a given measure- 
ment efficiency rj: 

dfi = -i[H, fi]dt - (1 ^ )7 [g, [q, fi]]dt - ^[q, [q, fi]]dt 



- {q)p, fi} {dQ - (q)pdt) , 



(20) 



and similarly for l|19|) . It is known that the noise term 
proportional to 1 — 77, like any further noise terms, can al- 
ways be reproduced formally by an interaction Hamilto- 
nian with a "heat bath" . Accordingly, we can transform 
the original SMEs of continuous measurement and esti- 
mation at measurement strength 7 and efficiency rj < 1 
into the theory of continuous measurement and estima- 
tion of the system+bath at measurement strength 777 and 
efficiency 77 = 1. Vice versa, if we trace over the bath, 
these SMEs reduce to the SMEs of the original system. 
According to our earlier theorem, valid for 77 = 1, the true 
and the estimated state of the system+bath converge to 
each other. This convergence implies, via tracing over the 
bath, that also fit and fi% converge to each other whereas 
both may remain mixed forever. 

Application to ensembles. The weak measurement 
paradigm also plays a role in applications where a large 
ensemble of the unknown state fi is accessible to the ex- 
periment, cf. e.g. Ref.0- Crucial in this context is the 
approximation that the collective state of the ensemble 
preserves the uncorrelated form fil = fif N if N is very 
large and the strength 7 C of the collective measurement 
is very small. In particular, we consider the same ob- 
servable q on each component and we measure their sum 
q c in a collective continuous measurement of strength 7°. 
For simplicity's sake only, we assume rj = 1 and apply 
the theory pgjl : 



dQ c 
dfi c 



(q c )pcdt + (^)- 1/2 dW, 
~llH c ,fi c }dt~^-[q c ,lq c ,fi c }}dt 



(21) 



+y {<r - <<r )p< . n w c - <<r >^) » (22) 



dfi ce = -t[H c ,fi ce ]dt~^[q c ,[q c ,fi ce }]dt 

+ 1 -{q c ~{q c )p^,fi ce }{dQ C -{q C )p-dt)(2i) 

where H c is the collective Hamiltonian, i.e., the sum 
of the same H for all N components. We extend 
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the approximation p c — for the estimate: p ce = 

(p e )® N . Substituting these forms, we obtain closed 
equations of the ensemble-continuous-measurement and 
single-system-estimation: 

dQ c = N(q) ? dt + (-/ c )-^ 2 dW, (24) 
dp = -i[H , p]dt - —[q,[q, p]]dt 

+ y {q - (4)p, p) (dQ c - N(q)pdt) , (25) 

dp e = -i[H,p e ]dt-^[q,[q,p e ]]dt 

+ ^{q~{o)^,p e }{dQ c -N(q)p.dt) . (26) 

These equations are identical to the Eas. l)fil8( l of contin- 
uous measurement and estimation on a single system, 
apart from two things. First, the strength j c of the col- 
lective measurement survives as the strength of the single 
state measurement. Second, the SMEs are governed by 
the collective signal Q1, as they should be. This latter 
fact leads usually to a faster convergence of pt and pi 
than the single state method, as it is plausible and could 
be verified from a detailed analysis. 

Remarks. As we anticipated in the text, there are ex- 
ceptions from convergence and from longtime purity 
of pt and pi . For trivial dynamics [H, q] = 0, the estimate 
pi will get stuck in any eigenstate of q, independently of 
p t which would converge to any other eigenstate as time 
goes by. However, these cases are of marginal impor- 
tance. In real tasks the dynamics is nontrivial and [H, q] 
does not vanish. We conjecture the following condition 
as sufficient for the universal convergence. Consider the 
Heisenberg operator q t of the measured observable, and 
determine the largest common eigenspace of all q t for 
t > 0. If this eigenspace is empty or one-dimensional then 
the convergence of pt and pi is always guaranteed. For 
instance, the position measurement of a particle yields 
a convergent state estimate in one dimension. The two- 
dimensional motion may be different. For a free particle, 
the simultaneous continuous measurement of both coor- 
dinates q x and q y is necessary otherwise the measured 
state may not become pure and the estimate may not 
converge to it. Interestingly, there is a chance of purity 
and convergence if we measure but one coordinate q x , 
provided a potential rotates q x 's Heisenberg- version in a 
proper non-trivial way. 

In practice, the (integrated) signal Q t is obtained from 
the experimental device doing the continuous measure- 
ment, so that Qt does not need computational efforts. 
On the other hand, the real-time estimate pi must be 
on-line calculated from Q t and one is interested in good 
algorithms. There are several options, depending on the 
concrete task. In case of optimum detection efficiency 
X] = 1, we can use a pure state estimate from the begin- 
ning. Then the density matrix equation (jSJ) is equivalent 
to the following stochastic Schrodinger equation for the 



state vector estimate: 

dip e = -iHlp e dt ~1{q-{q)^) 2 ^ e dt 
8 

+ l(q~(q)^)^ e (dQ-(q)^dt) . (27) 

Of course, if we calculate dpi = d[ip1 (ipf y] from the 
above stochastic Schrodinger equation, we get back (JBJ). 

Summary. To complete the standard theory of con- 
tinuous measurement, we have constructed a third Ito 
stochastic equation for the real-time state estimate, ex- 
ploiting the measured signal. Our theory I|17I19|I ap- 
plies to any system under time-continuous measurement. 
In this way, we have largely extended similar heuristic 
proposals [lj, |2| which used Gaussian estimates pi and 
requested, in principle, the perfect efficiency (signal-to- 
noise) of the time-continuous measurement. We proved 
analytically that our novel SME for the state estimate 
yields the true state for any non-trivial dynamics, at 
any nonzero efficiency of the measurement. The recent 
work on real-time estimate has sketched the Ito equa- 
tions in an alternative representation, without details of 
derivation and proof of the estimate's convergence to the 
true state. Our theory, due to the plain structure of the 
equations, can invariably be applied when several observ- 
ables are measured simultaneously, like the canonical co- 
ordinate and momentum q,p or the spatial coordinates 
Qx^Qy-i q z of a particle, as well as two or more components 
of a Pauli spin. We also showed that the theory applies 
when the state estimate relies on the collective continu- 
ous measurement on a large number of copies. Our SME 
applies to the experimental realizations of single state 
control, and we expect that it will contribute to a direct 
solution of state tomography from continuous measure- 
ment on ensembles, cf. e.g. Ref.Q. 
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